Topological Conditions of Scale-free Networks for Cooperation to Evolve 



Dong-Ping YangQ Hai Lin, Chen-Xu Wu, and J W Shuajt] 

Department of Physics and Institute of Theoretical Physics and Astrophysics, Xiamen University, Xiamen 361005, P.R.China 

(Dated: July 11, 2011) 

Evolutionary game theory is employed to study topological conditions of scale-free networks for the 
evolution of cooperation. We show that Apollonian Networks (ANs) are perfect scale-free networks, 
on which cooperation can spread to all individuals, even though there are initially only 3 or 4 hubs 
occupied by cooperators and all the others by defectors. Local topological features such as degree, 
clustering coefficient, gradient as well as topology potential are adopted to analyze the advantages of 
ANs in cooperation enhancement. Furthermore, a degree-skeleton underlying ANs is uncovered for 
understanding the cooperation diffusion. Constructing this kind degree-skeleton for random scale- 
free networks promotes cooperation level close to that of Barabasi-Albert networks, which gives 
deeper insights into the origin of the latter on organization and further promotion of cooperation. 
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Cooperation phenomena are ubiquitous and essential 
in natural and human systems pQ. Since selfish actions 
provide a short-term higher benefit, evolutionary game 
theory [2 has been employed widely to understand how 
and why cooperation emerges and survives. The Pris- 
oner's Dilemma (PD) game captures the essence of this 
problem. In PD game, each individual adopts coopera- 
tion or defection. Mutual cooperation or mutual defec- 
tion provides them both R or P, respectively while a de- 
fector can gain largest benefit T from a cooperator, which 
in turn receives S. From the order T > R > P > S, it is 
obviously better to defect, regardless of the opponent's 
strategy. In the well-mixed population, a strategy receiv- 
ing higher payoffs spreads within a population and the 
proportion of cooperators vanishes asymptotically. 

The interaction structure in real societies are more nat- 
urally to be described by complex networks and various 
networks have been reported to provide an asymptotic 
survival of cooperation [3], Notably, cooperation is en- 
hanced significantly in scale-free networks [H [5] . Espe- 
cially on the so-called Barabasi-Albert (BA) networks 
[5], the strong correlation between individuals renders 
cooperation as the dominating trait. While progress has 
been made in understanding general properties of social 
networks for enhancing cooperation [TlllOj. the question 
why BA networks possess such a great potential of coop- 
eration enhancement remains poorly understood. Fur- 
thermore, is there any better network for cooperation to 
evolve and what are the significant topological conditions 
in scale-free networks? 

In this Letter, we start from discussing perfect net- 
works for cooperation to evolve: Apollonian Networks 
(ANs) [IT] . We discover that cooperation can spread 
over the whole population on ANs throughout the en- 
tire Pareto-efficient parameter range (T + S < 2R), even 
though initially only 3 or 4 most-linked nodes (hubs) 
are occupied by cooperators and all the others by defec- 
tors. Then, a hidden degree-skeleton is introduced and 
demonstrated to be essential for cooperation spreading 



and further enhancement on ANs as well as BA networks. 
Constructing a degree-skeleton for random scale-free net- 
works [TjZ] promotes the cooperation level close to that of 
BA networks. Our findings deepen the insights into the 
origin of BA networks on cooperation organization and 
enhancement. 

ANs are constructed by adding a new node inside one 
of the existing triangles orderly, starting from a triangle. 
They are grown generation by generation and in each 
generation new nodes are just inserted into each triangle 
created in the last generation. The new node is attached 
to the three vertices of this triangle, which create three 
new triangles for next generation. We perform simula- 
tions of learning/replicator dynamics on ANs with size 
N = 10 4 . Note that ANs with 10 4 nodes are not com- 
plete for 10 generations [TTJ. Whether ANs are complete 
or not makes no difference. 

Following common practice [T3] , parameters of the PD 
game are chosen as R = 1, P = S = 0, and T = b > 1, 
where b represents the advantage of defectors over coop- 
erators and b < 2 means Pareto-efficient. Once ANs are 
constructed, the dynamics is carried out. Initially, co- 
operators and defectors are distributed randomly in the 
network with equal probability unless noted otherwise. 
At each round, each agent i plays once with all its neigh- 
bors and accumulates payoffs stored in 7^. Then, all in- 
dividuals update their strategies synchronously as well as 
asynchronously by the following rules: Each individual i 
selects at random a neighbor j and only if ttj > 7Tj, the 
player i adopts the strategy of its neighbor j with prob- 
ability LL-j.j = (itj — 7Tj)/max{fcj, kAb for next round 
robin. 

For simulations, let the system evolve for a transient 
time of 5 x 10 4 rounds and then several time windows 
of 10 3 rounds for checking whether the evolutionary dy- 
namics reaches a stationary regime. In each time win- 
dow, we record down the time evolution of coopera- 
tors proportion pc(t)- If the relative fluctuation F = 

V Pc(t) 2 — pc{t) 2 /pc(t) is not larger than 0.008 and the 
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FIG. 1. (a) The probability (pc that the final state is pc = 1 as 
a function of b on ANs for three different initial states: only 
first 3 hubs, only first 4 hubs, and randomly half of nodes, 
occupied by cooperators. 

slope of pc if) is smaller that 10 -3 , we stop the simula- 
tion and employ the average cooperation pc obtained in 
the last time window to be the asymptotic cooperation 
level. All results reported below are averaged over 10 3 
different realizations of networks and initial conditions. 

On ANs the population evolves definitely into two final 
states: pc = 1 or pc = 0. Fig.[T]shows the dependency of 
(pc on the defector's temptation 6, where (pc denotes the 
probability that the population reaches the final state of 
all cooperators (pc — 1)- All cooperation can be reached 
with certainty on ANs up to b = 2.4 and then cpc de- 
creases to rapidly when b increases up to 3, in the case 
that half of the population behave as cooperators ini- 
tially [H] , Surprisingly, just first 3 or 4 hubs initially 
occupied by cooperators and all other nodes by defectors 
can induce all cooperation for b < 2. These results im- 
ply that the hubs are extremely stable for cooperation 
with considerable powerful influences on their neighbors 
and even the whole population. The outstanding poten- 
tial for cooperation to evolve on ANs drives us to discuss 
their underlying topological properties in the following. 

First of all, ANs are scale-free networks with low de- 
gree exponent: P(k) ~ kr 1 with 7 = 1.59 [IT]. By the 
nature of PD game and updating rule, the most promi- 
nent mechanism of scale-free networks for promoting co- 
operation lies in the stability of cooperation on hubs |15j . 
A defector on the hub often induces most of his neigh- 
bors to be defectors and reduces the payoff of himself 
in return. Thus it can be easily invaded by cooperating 
neighbors with higher payoffs. On the contrary, cooper- 
ators on hubs strengthen their stability via assimilating 
their neighbors to be cooperators and get higher payoffs. 
Especially on networks with strong age-correlations, in- 
terconnections of hubs contribute furthermore the domi- 
nance of cooperation for b < 2 [4] , such as B A networks 
(7 = 3.0) generated via growth and preferential attach- 
ment. Notice that growth and preferential attachment 
can be also obtained via local rules of attachment, such 



as the minimal model [TB] and ANs. Furthermore, due 
to the lower degree exponent, the larger hubs in ANs will 
strengthen this effect, which results in further enhance- 
ment of cooperation. But we will show below that it just 
partly gives rise to our results in Fig. [T] 

Secondly, ANs are highly clustered with clustering co- 
efficient C c i — 0.83 and the correlation C c i{k) ~ k~ x [llj . 
The clustering coefficient [17] describes the connection 
probability of two neighbors. Enhancement of coopera- 
tion in highly clustered scale-free networks has also been 
discussed in detail in Ref . [7] . For networks with C c i close 
to 0, the conversion of cooperation into defection is ex- 
plained as a progressive invasion of the degree classes by 
defectors: The larger the value of b, the more degree hi- 
erarchies defectors have invaded [J5]. High degree nodes 
are more resistant to defection and there is a well-defined 
minimum preference of cooperation for intermediate de- 
gree classes. For highly clustered scale-free networks, in 
contrast, the density of triangles around hubs enhances 
the fixation of cooperation in low degree nodes when b 
is low, but homogenizes the invasion process of degree 
classes by defectors and then decreases the survival of 
low densities of cooperators at large b. For this reason, 
cooperation can be fixated over the whole population at 
low b and go to extinction when b is high. The following 
discussion will be persuasive on this point. 

Thirdly, ANs possess great local topological conditions 
for cooperation to stabilize. Another two local topolog- 
ical quantities: gradient g and topology potential U, in- 
troduced in |19j . have been shown a significant positive 
correlation with node's strategy preference. The gradient 
cji of node i is defined as the average Euclidian distance 

of degrees with its neighbors g{ = y ^7 Y^jeGti^i ~ ^') 2 i 
while the topology potential Ui is given by coupling node 
i's degree and gradient, Ui = ki * t^. When highly con- 
nected hubs tend to be occupied by cooperators stably, 
defectors can only manage to survive at nodes with low 
g and U . The players on nodes with higher g and U will 
pay more time to cooperate due to the influences from 
high-payoff cooperating neighbors |19) . In other words, 
higher g or U indicates more stability of cooperation on 
these nodes. We have checked cooperation stability of 
hubs on ANs in Fig. [TJ And Fig. [2] shows that ANs pos- 
sess nodes with high g and U, which will be demonstrated 
as an important factor for the promotion of cooperation 
on ANs below. 

Finally, we find that the special underlying global 
stYucixme- degree- skeleton is another important factor for 
cooperation to fixate on ANs. The degree-skeleton is a 
tree spanned by the maximal linked hub with gradual 
decrease of node's degree and traveling the whole net- 
work. It describes the condition that any node except the 
maximal-degree one has at least one higher-degree neigh- 
bor. In networks with a degree-skeleton, the asymmet- 
ric learning/replicator dynamics can be fully conducted 
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FIG. 2. (Color online) Distributions of gradient g and topol- 
ogy potential U for four different networks with identical de- 
gree distribution. The first three are derived from ANs with 
clustering coefficient C c i = 0.02. 




FIG. 3. Density of cooperators pc vs temptation b for ran- 
domly relinked networks (square) , degree-skeleton rebuilt net- 
works (triangle) and degree-skeleton kept networks (circle), 
which are derived from ANs with various identical C c ; and 
identical degree distribution. 



on the degree-skeleton. With cooperation stabilized on 
hubs, therefore, it will diffuse effectively from large de- 
gree nodes to small degree nodes and eventually diffuse 
over the whole network. 

In order to demonstrate last two points, we employ 
the Xulvi-Brunet-Sokolov algorithm [20 to relink the 
original ANs. At each step, two edges with four dif- 
ferent vertices are randomly relinked. This relink keeps 
the degree distribution but gradually destroys other lo- 
cal topological features, including C c i, g and U. The 
process is repeated in two ways: randomly relinking or 
keeping degree- skeleton, both until an identical given C c i 
is achieved, which detaches the effect of clustering coeffi- 
cient. The latter holds a degree-skeleton, which somehow 
keeps to a certain degree the above advantages: higher g 
and U as shown in Fig. [2] For comparison, we rebuild a 
random degree-skeleton for randomly relinked networks 
by attaching every local degree-maximum node to any 
higher-degree node, which belongs to the set of nodes 
spanned by the maximal linked hub through the pathway 
decreasing degree [2T] . These shortcuts change the global 
connection totally, but with few influence on all proper- 
ties of local topological conditions (Fig. [2]). Thus, degree- 
skeleton rebuilt networks possess a degree-skeleton com- 
pared to randomly relinked networks, but lower g and U 
than degree-skeleton kept networks. 

Randomly relinking destroys the degree-hierarchical 
structure and gives rise to many nodes to be local degree- 
maxima. The resulting random scale-free networks create 
some particular conditions where defectors can manage 
to survive [TH] . Such topological property hinders the co- 
operation to spread and induces the competition between 
local degree-maxima nodes as the case of dipole model 
[8]. At C c i — 0.02, certainly, the dependency of pc on b 
(Fig. [3jb), square) can be well understood in terms of the 
cooperation enhancing properties in the heterogeneously 
random networks [S]. From this, we are sure that the 
fixation of cooperation in ANs must not be simply an 



outcome of having higher hubs. And higher cooperation 
level at C c i = 0.15 (Fig. [3][a)) confirms the above point: 
the effect of clustering coefficient in cooperation enhance- 
ment. 

Rebuilding a random degree-skeleton to the above net- 
works enhances cooperation a lot and induces full co- 
operation at low b (Fig. [3j triangle), whatever the net- 
works are highly or lowly clustered. The degree-skeleton 
provides a pathway for cooperation stability to spread 
and sweeps away defector's surviving space. Specially, 
for degree-skeleton kept networks, the special degree- 
skeleton underlaid in ANs promotes cooperation signif- 
icantly by organizing the advantageous local topology 
conditions (higher g and U) for cooperation stability. 
The fixation of cooperation on them can be hold to much 
larger b, even though C c i is reduced to 0.02 (Fig. ^h), 
circle). These results indicate that degree-skeleton im- 
proves cooperation condition indeed and the association 
of degree-skeleton and higher g and U can enhance co- 
operation further. So we can arrive at the conclusion 
that the exactly special degree-skeleton underlying ANs 
provides a strong power for cooperation to fixate [22] . 

The deeper insight is that degree-skeleton can natu- 
rally lead to the exact one cluster of pure cooperators (the 
constant cooperators in all rounds after transient time), 
which was called as the cooperator core in Ref. [5J. Spe- 
cially in BA networks, the single cluster of pure coopera- 
tors [5] is also supposed to be induced by the underlying 
degree-skeleton. Here, we have checked that due to the 
age-correlation effect, a degree- hierarchical subnetwork 
spanned by the highest-degree hub indeed covers almost 
all nodes. There are just 2^5 local degree-maxima 
nodes and 10 ~ 30 nodes of 10 4 nodes excluded outside 
that subnetwork. Completing a degree-skeleton for BA 
networks makes almost no difference in the promotion 
of cooperation (Fig. |4][a)). In contrast, in random scale- 
free networks |12j , which usually have many local degree- 
maxima nodes, much lower cooperation level is achieved. 
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FIG. 4. (a) Density of cooperators pc vs temptation b for four 
networks with or without a full degree-skeleton, (b) Cluster 
number of pure cooperators vs the fraction of pure coopera- 
tors ppc for random scale-free networks and degree-skeleton 
constructed random scale- free networks, respectively. The fig- 
ure clearly shows that by constructing a degree skeleton for 
random scale-free networks, clusters of pure cooperators can 
merge together and then promote cooperation significantly. 



However, constructing a degree-skeleton for these net- 
works enhances the cooperation level close to that of BA 
networks (Fig. |4]Ja)) by merging clusters of pure coop- 
erators together (Fig. |4^b)). With cooperation stability 
on hubs, thereby, degree-skeleton indeed provides an im- 
portant pathway for cooperation stability to diffuse on 
non-clustered scale-free networks. These results imply 
that degree-skeleton is indeed an essential element for 
enhancement as well as organization of cooperation on 
scale-free networks. 

In summary, we have found perfect networks-ANs for 
cooperation to evolve and even fixate, as long as just 3 
or 4 cooperators taking up the most-linked hubs. ANs 
are highly clustered scale-free network with lower degree 
exponent and much better local topological conditions 
for cooperation to stabilize. Importantly, our results un- 
veil a special degree-skeleton underlying ANs providing 
a pathway for cooperation to spread over the whole net- 
work. Degree-skeleton is also vital in the mechanism of 
promoting cooperation on BA networks compared to ran- 
dom scale-free networks, which can also get as high co- 
operation level as BA networks just by constructing a 
random degree-skeleton. Due to usually asymmetrical 
interactions between hubs and other nodes, the hetero- 
geneous networks may induce many remarkable phenom- 
ena for various dynamics on them, such as signal trans- 
duction and response, synchronization and transport and 
so on [23] . It is worthwhile to investigate the function of 
degree-skeleton on different kinds of dynamics performed 
on scale- free networks. 
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